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Background of the Invention 
Field of the Invention 

The present invention relates to the pattern 
retrieving technology for retrieving a pattern from 
a search object, and more specifically to the 
pattern retrieving technology for collectively and 
simultaneously processing retrieval requests when 
the retrieval requests are received from a 
plurality of terminal devices, and returning 
retrieval results to respective terminal devices, 
thereby exceedingly shortening the entire 
processing time. 

Description of the Related Art 

Conventionally, a full text retrieval system 
has been adopted using a character string collating 
method. A full text retrieval system using a 
character string collating method refers to a 
system of checking whether or not there is a 
specified character string in the text data to be 



searched while sequentially collating the specified 
character string with text data to be searched from 
the start to the end of the text data to be 
searched . 

5 However, in the full text retrieval system 

using the character string collating method, the 
CPU of the system performs a collating operation 
while the CPU of the system is scanning the text 
data. Therefore, any other processes cannot be 

10 performed during the collating operation, and it is 
difficult for a system, in which a plurality of 
user terminals are connected to a retrieval device, 
to provide a retrieving service to the plurality of 
user terminals. 

15 That is, when a plurality of user terminals 

are connected to a retrieval device which performs 
a full text searching process, and each of the user 
terminals frequently issues a retrieval request to 
the device, the CPU of the retrieval device which 

20 has started a retrieving process cannot perform 
other processes during the text scanning operation, 
and all other requests are kept waiting until the 
CPU has completed the character collating operation. 
Furthermore, there has been the problem that, 

25 when retrieval device receives the same retrieval 



requests from different user terminals at almost 
the same time, it has to wastefully repeat the same 
retrieving process for the retrieval requests. 



Summary of the Invention 

The present invention has been developed to 
solve the above mentioned problems, and aims at 
providing a retrieving method, a retrieval device, 
a computer-readable storage medium storing a 
retrieval program, a retrieval system, and a 
retrieval program capable of returning to each user 
terminal a retrieval result in almost the same 
response time as in the case where one user 
terminal is connected to one retrieval device 
although retrieval requests are continuously 
transmitted from a plurality of user terminals to a 
retrieval device which is connected to the 
plurality of user terminals and carries out a full 
text search. 

The present invention also aims at providing a 
retrieving method, a retrieval device, a computer- 
readable storage medium storing a retrieval program, 
a retrieval system, and a retrieval program capable 
of performing a retrieving process without 
performing wasteful retrieving processes when the 



same retrieval requests are received from different 
user terminals at almost the same time. 

The pattern retrieval apparatus according to 
the present invention is connected to a plurality 
of terminal devices through a network, and includes 
a retrieval target data storage unit, a retrieval 
condition reception unit, a retrieval condition 
buffer unit, a retrieving process determination 
unit, a retrieval pattern variable table generation 
unit, a retrieval request expression variable table 
generation unit, a retrieval unit, and a 
transmission unit. 

According to the first aspect of the present 
invention, the retrieval target data storage unit 
stores data to be searched. The retrieval condition 
reception unit receives the retrieval condition, 
transmitted from each of the plurality of terminal 
devices together with the terminal device 
information for designation of each of the terminal 
devices, including the retrieval pattern and the 
retrieval expression for retrieval of the data to 
be searched. The retrieval condition buffer unit 
stores the retrieval condition and the terminal 
device information received by the retrieval 
condition reception unit. The retrieving process 



determination unit determines whether or not the 
preceding retrieving process is being performed. 
When the retrieving process determination unit 
determines that the preceding retrieving process is 
5 not being performed, the retrieval pattern variable 
table generation unit generates a retrieval pattern 
variable table in which a retrieval pattern and a 
first variable having the retrieval pattern as a 
value are associated with each other, if there are 

10 two or more identical retrieval patterns in the 
retrieval patterns stored in the retrieval 
condition buffer units, excluding the retrieval 
patterns other than one retrieval pattern. The 
retrieval request expression variable table 

15 generation unit generates a retrieval request 
expression variable table in which the retrieval 
request expression indicating the retrieval pattern 
using the first variable and the second variable 
having the retrieval request expression as a value 

20 are associated, and the retrieval request 
expression indicating the terminal device 
information and the retrieval expression using the 
second variable and the second variable having the 
retrieval request expression as a value are 

25 associated based on the retrieval expression and 



the terminal device information stored in the 
retrieval condition buffer unit, and the retrieval 
pattern variable table generated by the retrieval 
pattern variable table generation unit. The 
retrieval unit extracts a retrieval result matching 
the retrieval condition transmitted from each of 
the plurality of terminal devices by searching the 
retrieval target data storage unit according to the 
retrieval request expression variable table 
generated by the retrieval request expression 
variable table generation unit. The transmission 
unit transmits the retrieval result extracted by 
the retrieval unit to each of the plurality of 
terminal devices . 



Brief Description of the Drawings 

FIG. 1 shows the configuration of the function 
of the pattern retrieval system to which the 
present invention is applied; 

FIG. 2 is a flowchart of the pattern 
retrieving process performed by a pattern retrieval 
apparatus 4 explained by referring to FIG. 1 ; 

FIG. 3 shows a state transition table in the 
AC method; 

FIG. 4 shows a determination table of the 



determination 1 shown in FIG. 3; 

FIG. 5A shows a Deltal table used in the EBM 
method; 

FIG. 5B shows a table for determination of the 
right end of a pattern; 

FIG. 6 shows an example of an 'erroneous read' 
of Japanese text; 

FIG. 7 shows an example of the automaton 
reflecting the characteristic of code system in the 
Japanese text; 

FIG. 8 shows detecting a pattern based on the 
state transition; 

FIG. 9 shows a concept model of the full text 
retrieval system in the character string collating 
method according to the present invention; 

FIG. 10 shows an example of the contents of 
text data to be searched; 

FIG. 11 shows an example of a retrieval 
re guest ; 

FIG. 12 shows the concept of a retrieval 
reguest group; 

FIG. 13 shows an example of the entire 
configuration of the present invention; 

FIG. 14 is a flowchart showing the flow of the 
process by the control program; 
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FIG. 15 is a flowchart showing the flow of the 
process by the reception program; 

FIG. 16 is a flowchart showing the flow of the 
process of a requester thread; 

FIG. 17 shows the concept of the process of 
writing a retrieval request to the retrieval 
request table; 

FIG. 18 shows the concept of the process of 
returning a retrieval result to a terminal; 

FIG. 19 shows the entire structure of the 
retrieval program; 

FIG. 20 is a flowchart showing the flow of a 
pre-process ; 

FIG. 21 shows the concept of the keyword 
variable table generating process according to the 
first embodiment; 

FIG. 22 shows the concept of the retrieval 
request expression variable table 48 generating 
process according to the first embodiment; 

FIG. 23 is a flowchart showing the flow of the 
retrieving process; 

FIG. 24A shows an example (1) of a keyword 
variable table according to the first embodiment of 
the present invention; 

FIG. 24B shows an example (1) of a retrieval 



request expression variable table according to the 
first embodiment of the present invention; 

FIG. 25A shows an example (2) of a keyword 
variable table according to the first embodiment of 
the present invention; 

FIG. 25B shows an example (2) of a retrieval 
request expression variable table according to the 
first embodiment of the present invention; 

FIG. 26 shows an example of a retrieval result 
table according to the first embodiment of the 
present invention; 

FIG. 27 shows the contents of the text data to 
be searched according to the second embodiment of 
the present invention; 

FIG. 28 shows the concept of the keyword 
variable table generating process according to the 
second embodiment of the present invention; 

FIG. 29 shows the concept of generating a 
retrieval request expression variable table 
according to the second embodiment of the present 
invention; 

FIG. 30A shows an example of the keyword 
variable table generating process according to the 
second embodiment of the present invention; 

FIG. 30B shows an example .of a retrieval 
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request expression variable table according to the 
second embodiment of the present invention; 

FIG. 31 shows an example of a retrieval result 
table according to the second embodiment of the 
present invention; and 

FIG. 32 shows loading a program into a 
computer according to the present invention. 

Description of the Preferred Embodiments 

The embodiments of the present invention are 
described below in detail by referring to the 
attached drawings. 

To solve the problem, the present invention 
adopts the following configurations. 

That is, according to an embodiment of the 
present invention, in a pattern retrieval system in 
which a plurality of terminal devices are connected 
to a pattern retrieval apparatus through a network, 
the pattern retrieving method, the pattern 
retrieval apparatus, the computer-readable storage 
medium storing a pattern retrieval program, the 
pattern retrieval system, and the pattern retrieval 
program according to the present invention receive 
the retrieval condition containing a retrieval 
pattern for retrieval of data to be searched and a 



retrieval expression transmitted from each of the 
above mentioned plurality of terminal devices 
together with the terminal device information for 
designation of each of the terminal device, store 
5 the received retrieval condition and terminal 
device information in the retrieval condition 
buffer, determines whether or not the preceding 
retrieving process is being performed, generates, 
when it is determined that the preceding retrieving 

10 process is not being performed, a retrieval pattern 
variable table in which a retrieval pattern and a 
first variable having the retrieval pattern as a 
value are associated with each other, if there are 
two or more identical retrieval patterns in the 

15 retrieval patterns stored in the retrieval 
condition buffer, excluding the retrieval patterns 
other than one retrieval pattern, generates a 
retrieval request expression variable table in 
which the retrieval request expression indicating 

20 the retrieval pattern using the first variable and 
the second variable having the retrieval request 
expression as a value are associated, and the 
retrieval request . expression indicating the 
terminal device information and the retrieval 

25 expression using the second variable and the second 
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variable having the retrieval request expression as 
a value are associated based on the retrieval 
expression and the terminal device information 
stored in the retrieval condition buffer, and the 
generated retrieval pattern variable table, 
extracts a retrieval result matching the retrieval 
condition transmitted from each of the plurality of 
terminal devices by searching the retrieval target 
database according to the generated retrieval 
request expression variable table, and transmits 
the extracted retrieval result to each of the 
plurality of terminal devices. 

Thus, when there are a number of retrieval 
requests in a short time, the process can be 
performed at a much higher speed than in the 
conventional technology. 

Furthermore, it is desired that the retrieval 
condition is stored in the retrieval condition- 
buffer until it is determined that the retrieving 
process being performed bas been completed. 

It is also desired that the retrieval 
condition buffer stores the retrieval condition 
until a predetermined time is reached or a 
predetermined capacity is filled. 

It is also desired that the above mentioned 
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retrieval is performed by simultaneously retrieving 
a plurality of retrieval patterns. 

Furthermore, it is desired that the above 
mentioned retrieval is performed in the Aho- 
Corasick (AC) method, the Expanded-Boyer-Moore 
(EBM) method, or the Shinohara-Arikawa (SA) method. 

FIG. 1 shows the configuration of the function 
of the pattern retrieval apparatus to which the 
present invention is applied. 

In FIG. 1, a pattern retrieval system 1 
comprises a plurality of terminal devices 3 
connected to the- pattern retrieval apparatus 4 
through a electric communications circuit 2. 

Each of the terminal devices 3 comprises a 
terminal device side transmission unit 31, and a 
terminal device side reception unit 32 . 

The pattern retrieval apparatus 4 comprises a 
retrieval target data storage unit (database) 41, a 
retrieval condition reception unit 42, a retrieval 
condition buffer unit 43, a retrieving process 
determination unit 44, a retrieval pattern variable 
table generation unit 45, a retrieval pattern 
variable table 4 6, a retrieval request expression 
variable table generation unit 47, a retrieval 
request expression variable table 48, a retrieval 
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unit 49, and a transmission unit 50. 

The terminal device side transmission unit 31 
transmits the retrieval condition containing a 
retrieval pattern for retrieval of data to be 
5 searched and a retrieval expression together with 
the terminal device information for designation of 
the terminal device 3. 

The retrieval target data storage unit 41 
stores the data to be searched. 

10 The retrieval condition reception unit 42 

receives the retrieval condition, transmitted from 
the terminal device side transmission unit 31 of 
each of the plurality of terminal devices 3 
together with the terminal device information for 

15 designation of each of the terminal devices 3, 
including the retrieval pattern and the retrieval 
expression for retrieval of the data to be searched. 

The retrieval condition buffer unit 43 stores 
the retrieval condition and the terminal device 

20 information received by the retrieval condition 
reception unit 42. For example, the retrieval 
pattern is stored until the retrieving process 
determination unit 44 determines that the 
retrieving process bas been completed, or until a 

25 predetermined time is reached or a predetermined 
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capacity is filled. 

The retrieving process determination unit 44 
determines whether or not the preceding retrieving 
process is being performed. 



44 determines that the preceding retrieving process 
is not being performed, the retrieval pattern 
variable table generation unit 45 generates a 
retrieval pattern variable table 4 6 in which a 

10 retrieval pattern and a first variable having the 
retrieval pattern as a value are associated with 
each other, if there are two or more identical 
retrieval patterns in the retrieval patterns stored 
in the retrieval condition buffer units 43, 

15 excluding the retrieval patterns other than one 
retrieval pattern. 

The retrieval request expression variable 
table generation unit 47 generates a retrieval 
request expression variable table 48 in which the 

20 retrieval request expression indicating the 
retrieval pattern using the first variable and the 
second variable having the retrieval request 
expression as a value are associated, and the 
retrieval request expression indicating the 

25 terminal device information and the retrieval 
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determination unit 
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expression using the second variable and the second 
variable having the retrieval request expression as 
a value are associated based on the retrieval 
expression and the terminal device information 
stored in the retrieval condition buffer unit 43, 
and the retrieval pattern variable table 46 
generated by the retrieval pattern variable table 
generation unit 45. 

The retrieval unit 49 extracts a retrieval 
result matching the retrieval condition transmitted 
from each of the plurality of terminal devices by 
searching the retrieval target data storage unit 
according to the retrieval request expression 
variable table 48 generated by the retrieval 
request expression variable table generation unit 
47. In a retrieving method, a plurality of 
retrieval patterns can be retrieved. For example, 
the Aho-Corasick (AC) method, the Expanded-Boyer- 
Moore (EBM) method, or the Shinohara-Arikawa (SA) 
method can be used. These AC, EBM, and SA methods 
are briefly described later. 

The transmission unit 50 transmits the 
retrieval result extracted by the retrieval unit 49 
to each of the plurality of terminal devices 3. 

The terminal device side reception unit 32 
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receives a result transmitted from the transmission 
unit 50. 

FIG. 2 is a flowchart of the pattern 
retrieving process performed by the pattern 
retrieval apparatus 4 described by referring to FIG. 
1 . 

When the process is started, first in step SI, 
the retrieval condition reception unit 42 of the 
pattern retrieval apparatus 4 receives the 
retrieval condition including a retrieval pattern 
for retrieval of data to be searched and a 
retrieval expression transmitted from the terminal 
device side transmission unit 31 of each of the 
plurality of terminal devices 3 together with 
terminal device information for designation of each 
terminal device 3 . 

In step S2, the retrieval condition buffer 
unit 43 of the pattern retrieval apparatus 4 
temporarily stores the received retrieval condition 
and terminal device information in the buffer 
memory . 

In step S3, the retrieving process 
determination unit 44 of the pattern retrieval 
apparatus 4 determines whether or not the preceding 
retrieving process is being performed. 
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If it is being performed (YES in step S3), 
then control is returned to step SI, another 
retrieval conditions, etc. are received from the 
terminal device side transmission unit 31, and 
5 temporarily stored in the buffer memory (step S2) . 
The reception (step SI) and the storage (step S2) 
are repeated until it is determined in step S3 that 
the preceding retrieving process has been completed 
by the retrieving process determination unit 44. 

10 Although it is determined that the preceding 
retrieving process has been completed, the above 
mentioned retrieval condition, etc. can be 
received/stored until a predetermined time is 
reached or a predetermined capacity is filled. 

15 On the other hand, if it is determined in step 

S3 that a retrieving process is not being performed 
(that the preceding retrieving process has been 
completed) (NO in step S3) , then, in step S4, the 
retrieval pattern variable table generation unit of 

20 the pattern retrieval apparatus 4 generates a 
retrieval pattern variable table 46 in which a 
retrieval pattern and a first variable having the 
retrieval pattern as a value are associated with 
each other, if there are two or more identical 

25 retrieval patterns in the retrieval patterns stored 
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in the retrieval condition buffer units 43, 
excluding the retrieval patterns other than one 
retrieval pattern. 

Then, in step S5, the retrieval request 
5 expression variable table generation unit 47 of the 
pattern retrieval apparatus 4 generates a retrieval 
request expression variable table 48 in which the 
retrieval request expression indicating the 
retrieval pattern using the first variable and the 

10 second variable having the retrieval request 
expression as a value are associated, and the 
retrieval request expression indicating the 
terminal device information and the retrieval 
expression using the second variable and the second 

15 variable having the retrieval request expression as 
a value are associated based on the retrieval 
expression and the terminal device information 
stored in the buffer memory, and the generated 
retrieval pattern variable table 46 generated by 

20 the retrieval pattern variable table generation 
unit 45. 

Then, in step S6, the retrieval unit 49 of the 
pattern retrieval apparatus 4 extracts (retrieves) 
a retrieval result matching the retrieval condition 
25 transmitted from each of the plurality of terminal 
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devices 3 by searching the retrieval target data 
storage unit 41 according to the generated 
retrieval request expression variable table 48 in 
the method of simultaneously retrieving a plurality 
of retrieval patterns, that is, the AC, EBM, or SA 
method. 

Finally, in step S7, the transmission unit 50 
of the pattern retrieval apparatus 4 transmits the 
extracted retrieval result to each of the plurality 
of terminal devices 3. The terminal device side 
reception unit 32 of the terminal device 3 receives 
the above mentioned retrieval result. 

Briefly described below are the above 
mentioned AC, EBM, and SA methods. 

First, the AC method is briefly described. 
The AC method is described in detail in the 
reference 1 (Aho.A.V. and Corasick .M . J . , 'Efficient 
String Matching: An Aid to Bibliographic Search', 
Comm. ACM, vol.18, no. 6, pp. 33-340, 1975). 

The AC method is an algorithm of a pattern 
matching engine devised by Alfred Aho and Margaret 
Corasick, the authors of the above mentioned 
reference 1. In this method, character strings to 
be searched can be detected only in one searching 
process from start to end. 



• 
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Described below is the basic logic of 
detecting a character string to be retrieved from 
character string to be searched according to the AC 
algorithm . 

5 Normally, in the information processing 

CI 

;|i technology, a character string is actually 

expressed by an array of binary values referred to 
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as bits represented by 0 or 1 . A character string 
is an array of binary numbers if it is decomposed 
s 10 in a bit unit, but it is an array of hexadecimal 

111 numbers if it is decomposed in 4-bit units, or an 

Q 

Ly array of the 256-number numeration if it is 

decomposed in 4-bit units. 

In this example, the basic logic of the AC 
15 algorithm is described with a character string 
processed as an array of hexadecimal numbers. 

First, there are three words to be retrieved, 
that is, '1i±(9578 8E6D) ' (two Japanese characters 
(their respective character codes)), ' PI M (8F75 
20 8DF5) 1 (two Japanese characters (their respective 

character codes)), and ' iti (8D82 91AC) • (two 
Japanese characters (their respective character 
codes) ) . The numbers enclosed by the parentheses 
are the hexadecimal representation of the words to 
25 be retrieved. 
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Assume that the character string to be 

searched is ' S dt <D M f£ M ( 9578 8E6D 82CC 8F75 
8DF5 82CD 92B4 8D82 91AC) ' (nine Japanese 
characters (their respective character codes) ) with 
' (D (82CC) ' (one Japanese character (its character 
code)), 1 (A (82CD)' (one Japanese character (its 
character code)), and ' 3§ (92B4) 1 (one Japanese 
character (its character code)) . 

The pattern matching engine first generates a 
state transition table as shown in FIG. 3 based on 
the above mentioned words to be retrieved. 

In FIG. 3, it is determined in 'determination 
1' whether or not an arbitrary 4 bits (the n-th 
four bits in the character string to be searched is 
9 or 8, or neither 9 or 8 . If it is 9, the 
determination 2-1 is performed. If it is 8, the 
determination 2-2 is performed. Otherwise, the 
determination 1 is performed on the (n+l)th four 
bits. 

In the determination 2-1, it is determined 
whether or not the (n+l)th four bits refer to 5 or 
any of other numbers. If it is 5, the determination 
3-1 is performed on the (n+2)th four bits. 
Otherwise, the determination 1 is performed on the 
(n+l)th four bits. 
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Similarly, the determination is sequentially 
continued in 4-bit units. 

In the above mentioned process, if the 
determination 8-1 is performed and the determined 
four bits refer to D, then the word to be retrieved 

1 m i ' (two Japanese characters (their respective 
character codes)) has been successfully retrieved. 
If the determination 8-2 is performed and the 
determined four bits refer to C, then the word to 
be retrieved ' ifFiif ' (two Japanese characters (their 
respective character codes)) has been successfully 
retrieved. If the determination 8-3 is performed 
and the determined four bits refer to 5, then the 

word to be retrieved 1 [$1^5 ' (two Japanese characters 
(their respective character codes) ) has been 
successfully retrieved. 

There are three words to be retrieved, that is, 
' !l dr ' (two Japanese characters (their respective 
character codes)), ' ilh ill ' (two Japanese characters 
(their respective character codes)), and ' ' (two 
Japanese characters (their respective character 
codes)), but the determination is not performed 
three times in the determination 1 . Actually, the 
determination is performed twice whether the word 
refers to 9 or 8. However, since the determination 
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is performed whether the word refers to D or F in 
the determination 2-2. Therefore, although the 
determination frequency reduction in the 
determination 1 seems to be insignificant, the 
5 determination frequency can be practically reduced 

Q 

Cj if the result of the determination 1 is not 8 

Cl 

iQ because, in this case, the determination 2-2 can be 

m 

p| skipped. If the probability of the occurrence of 

ill 

IP! 



each value is equal, then the probability of the 
10 occurrence of 8 is 1/16, thereby obtaining the 
probability of performing the determination 2-2 is 



fit • 

q 

W also 1/16 

o 



In the scope of the above mentioned 
explanation, the character string collating time 

15 more or less depends on the number of words to be 
retrieved although the determination frequency is 
actually reduced. Especially, when the number of 
words to be retrieved is small, the determination 
frequency reduction effect is also small. 

20 However, each determining process can be 

efficiently performed in the following method. 

In each determining process, a determination 
table as shown in FIG. 4 is used. FIG. 4 shows the 
determination table for the determination 1. In FIG. 

25 4, if the 4-bit value to be determined is 9, then 
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the following four bits are determined according to 
the determination table of the determination 2-1. 
Otherwise, the following four bits are determined 
according to the determination table of the 
5 determination 1. 

Q 

The determination is carried out as described 
>fj below according to the determination table. 

fi'i Using the above mentioned character string to 

fl | 

j£j be searched, the first value is 9. Therefore, the 

! ! 10 column containing 9 as a 4-bit value to be 

fU determined on the determination table is directly 

L'j checked, and control is passed to the determination 

Q 

f=* table of the determination 2-1. That is, whatever 

the contents of the determination table are, all 
15 the user has to do is to check the column only. 
Therefore, the determining .time on the 
determination table does not depend on the number 
of the words to be retrieved. 

Afterwards, by scanning the character string 
20 to be searched according to the determination table, 
the collation between the entire character string 
to be searched and the entire word to be retrieved 
can be completed in one scanning operation. 

When there is a hit on the last determination 
25 table, the collation result information such as a 
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hit character string, the positional information 
about the character string, etc. is stored in the 
destination table column. When control is passed to 
the table, the collation result information is 
5=; 5 retrieved. 

In the above mentioned explanation, a 

*M character is segmented in a 4-bit unit, and then a 

Oil 

Ilj determination table is generated. If a character is 
fU 

y = j segmented in a 8-bit unit, the probability of the 
10 transition to the next determination table is 1/256, 

ill 



a 
w 
a 

1=3, 



thereby further reducing the processing time. 

Although the time required to generate a state 
transition table is added to a retrieving process, 
the time is considerably shorter than a normal 
15 retrieving time. Therefore, it little affects the 
entire processing time. 

Described briefly below is the EBM method. 
The EBM method is an algorithm obtained by 
extending the BM (Boyer-Moore) method such that a 
20 plurality of patterns can be processed. In the EMB 
method, like in the AC method, a plurality of 
patterns can be detected by scanning the text in 
one operation only. As compared with the AC method, 
the EBM method requires a smaller work area with 
25 relatively high efficiency. 
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Described first is the outline of the BM 

method. In the BM method, a character string to be 

searched is collated with a pattern from the end to 

the start of the pattern. If a non-matching result 

5 is output in the collating process, the collation 

position of the character string to be searched is 

4 P= shifted backward, and the collation is resumed from 

pjj the end of the pattern. The process is repeatedly 

* ? 'J performed until the collation position reaches the 

IJ1 

£ 10 end of the character string to be searched. How 

K 

fU many characters have to be backward skipped for 

Q 

y_| collation when a non-matching result is output can 

P 

^ be uniquely determined by the character of the 

character string to be searched at which the non- 
15 matching result is output. Based on a given pattern, 
a correspondence table of a character to the number 
of skipped characters can be generated. 

For example, when the pattern ' ABCD ' is given, 
the table is a DELTA1 table (one-dimensional array 
20 of non-zero integers) such as del_abcd shown in FIG. 
5A. The upper columns refer to the characters of 
the character string to be searched when a non- 
matching result is output in the collating process, 
and the lower columns indicate how many characters 
25 the collation position has to skip backwards. The 
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value of the trailing character of the pattern in 
the lower column is set to 0. The value of the 
character not existing in the pattern in the lower 
columns refers to the number of characters of the 
5 pattern. When the collating process is performed, 
the trailing character of the pattern and the 
character at the collation position in the 
character string to be searched are first retrieved, 
and the value of the character corresponding to the 

10 character in the lower column on the deltal table 
is checked. if the value is 0, then the character 
matches the trailing character of the pattern. 
Therefore, the collating process is performed 
forward. If the value in the lower column is equal 

15 to or larger than 1, then the trailing character of 
the pattern is collated with the collation 
positions of the character string to be searched 
and the pattern shifted backward by the number of 
characters indicated by the value. The collating 

20 process is completed after the above mentioned 
process is repeated until the collation position 
reaches the end of the character string to be 
searched . 



The table is used as follows in the EBM. 
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If two patterns ' ABCD 1 and ' BCDE ' are given, a 
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deltal table (a one-dimensional array of non- 
negative integers) such as del_abcd and del_bcde, 
etc. shown in FIG. 5A is generated for each pattern. 
Then, these tables are combined (a smaller value in 
the values for the same characters is selected) , 
and a deltal table as del_com shown in FIG. 5A is 
generated. When the minimum value is 0, a large 
value L (large: number of characters of the 
character string to be searched + number of 
characters of the pattern + 1) replaces 0. The L is 
used for determination of the end of the collating 
process . 

When the trailing character of the pattern is 
detected (when the value of deltal is large) , it is 
to be indicated which pattern relates to the 
trailing character by generating the table as shown 
in FIG. 5B. The figures (1, 2, 3) shown in FIG. 5B 
indicate respective patterns. 

Using the del_com shown in FIG. 5A and 5B, the 
retrieving process can be completed in one 
collating process on a character string to be 
searched from the start to the end the character 
string although there are a plurality of patterns 
by performing the similar collating process of the 
BM method. 
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Finally, the SA method is briefly described. 

The SA method is an algorithm of the case in 
which a pattern matching process is performed 
between a character string and Japanese text. 

The Japanese text contains a combination of 2- 
byte characters and 1-byte characters. When 2-byte 
characters and 1-byte characters are combined, it 
is not possible to easily determine whether a 
target character code refers to a 1-byte character 
or a 2-byte character. That is, unless the process 
is performed with the segmentation of a character 
recognized from the start of a character string, 
the erroneous read occurs as shown in FIG. 6. 

The above mentioned AC method and the EBM 
method disclose efficient methods of performing 
collating processes on a plurality of patterns, but 
do not disclose a method of efficiently solving the 
problem of the erroneous read. With Japanese text, 
any method cannot be effectively applied without 
solving the problem of the erroneous read. Based on 
the AC method, the SA method describes means for 
solving the problem of the erroneous read as 
follows . 

One of the methods for solving the problem of 
the erroneous read is to perform a pattern matching 
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process with the boundary between a 1-byte 
character and a 2-byte character constantly 
recognized to prevent an erroneous read. To attain 
this, an automaton reflecting the characteristic of 
a code system (shift JIS) in Japanese text is 
formed, and a pattern matching process is performed 



FIG. 7 shows an example of an automaton 

[W reflecting the characteristic of a code system in 
y'\ 

= 10 Japanese text. 

III The automaton shown in FIG. 7 has a set of 

Q 

y patterns {AB, (one Japanese character (its 



character code) ) , JH (one Japanese character (its 
character code))} as a target. The status 7 shown 

15 in FIG. 7 indicates an intermediate status toward 
which the broken lines of the status 3 and 5 are 
led. When the status 3 and 5 cannot be changed into 
another status, they are first led to the 
intermediate status 7. After adjusting the 

20 erroneous read in the intermediate status 7, the 
status 0 is entered. In this method, the adjustment 
of the erroneous read can be efficiently made in 
the matching process. 

For example, when ' WtfL <D %fl ft 1 (five Japanese 

25 characters (their respective character codes) ) is 
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given as text, the state transition shown in FIG. 8 
occurs, and the pattern can be correctly detected. 

The AC method and the EBM method are described 
in the reference document 2 ('Realizing five types 
of pattern matching methods using a function in C 
language, First case, English text 1 , NIKKEI 
BYTE/AUGUST 1987) . The SA method if described in 
the reference document 3 ('Realizing five types of 
pattern matching methods using a function in C 
language, Second case, Japanese text' , NIKKEI 
BYTE/SEPTEMBER 1987) . 

FIG. 9 shows a concept model of the character 
string collating method of the full text retrieval 
system (hereinafter referred to as the present 
system) . 

The present system extracts the information 
satisfying each retrieval request from the text 
data to be searched in response to the retrieval 
requests irregularly issued from a plurality of 
terminals, and returns the information as a 
retrieval result to each terminal. FIG. 10 shows an 
example of the contents of the text data to be 
searched. The entire text data to be searched is 
referred to as a file. A file comprises a plurality 
of records, and each record comprises a plurality 
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of items. An item contains a character string, and 
a record can be identified by a record delimiter. 
An item in a record is segmented by an item 
delimiter, and can be uniquely designated by an 
item identification code (hereinafter referred to 
as an item tag) . 

Retrieval requests are frequently received by 
the present system in time series. As shown in FIG. 
11, each retrieval request has an array of 
information including a combination of an item tag 
and a word to be retrieved, and a retrieval 
condition expression. These pieces of information 
indicate that a specified word to be retrieved 
exists in the item specified by the item tag in the 
record to be searched, and that a request to search 
for a record satisfying a retrieval condition 
expression has been issued. 

Then, the present system detects records 
satisfying a retrieval request in a file, and 
returns a part or all of the records to a retrieval 
requester . 

The full text retrieval system using the 
character string collating method as shown in FIG. 
9 conventionally performs a retrieving process and 
returns a retrieval result to a terminal each time 
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a retrieval request is issued by the terminal. 
According to the present invention, a retrieving 
process is performed collectively for retrieval 
requests from a plurality of terminals, and after 
the retrieving process, the retrieval results are 
returned to the respective terminals, thereby 
remarkably shortening the entire processing time. 

Although retrieval requests are frequently 
received by the present system in time series, each 
retrieval request is not individually processed, 
but a plurality of retrieval requests are 
collectively processed. A set or retrieval requests 
to be collectively processed is referred to as a 
retrieval request group. FIG. 12 shows the concept. 

A retrieval request group is configured as 
follows . 

All retrieval requests received while the 
present system is performing the process of a 
retrieval request group are kept waiting, and all 
retrieval requests waiting at the point where the 
process of the retrieval request group being 
processed is completed are defined as the next 
retrieval request group. If there are no waiting 
retrieval requests, a retrieval request group is 
configured by the first retrieval request to be 



35 



received next. The number of retrieval requests 
contained in the first retrieval request group is 
one . 

FIG. 13 shows an example of the entire 
configuration according to the present invention. 

The present invention is configured by an 
information processing device, a magnetic file 
device, and a program storage device. The 
components of the program storage device are a 
control program, a reception program, a requester 
thread, a retrieval request table, a retrieval 
result table and a retrieval program. 

FIG. 14 is a flowchart showing the flow of the 
process of a control program. 

After performing a system initializing process 
on various tables, etc. (step S141), the control 
program is activated (step S142) and simultaneously 
the reception program is activated (step S143) . 

FIG. 15 is a flowchart showing the flow of the 
process of the reception program. 

The reception program is constantly waiting a 
retrieval request from a terminal (step S151), and 
activates a requester thread each time a retrieval 
request is received from a terminal (step S152) . 
The number of requester threads equals the number 
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process in step S161. 

Then, the requester thread enters the wait 
state for the completion of the retrieving process 



of retrieval requests. 

FIG. 16 is a flowchart showing the flow of the 
process of a requester thread. 

After being activated, the requester thread 
5 writes a retrieval request to a retrieval request 

Q 

J;| table (step SI 61) . FIG. 17 shows the concept of the 

m 
ru 
m 

lf| 

s 10 (step S162) . After the retrieving process, the 

|=i, 

I1J retrieval result is written to the retrieval result 

Q 

yj table, and the last expression variable ID 

□ 

Jj, indicating to which retrieval result table an 

answer to each requester thread has been written is 

15 written to a common area. After exiting the wait 
state, the requester thread refers to the last 
expression variable ID of its area in the common 
area (step S163), retrieves the contents of a hit 
record (step S164) from the retrieval result table, 

20 edits an answer (step S165) , and returns the result 
to the terminal (step S166) . FIG. 18 shows the 
concept of the processes in steps S162 through S165, 
FIG. 19 shows the entire structure of a 
retrieval program. 

25 A retrieval program is configured by a 
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preprocess, a retrieving process, a postprocess, 
etc . 

FIG. 20 is a flowchart showing the flow of the 
preprocess . 

The preprocess first prohibits a new requester 
thread from being written to the retrieval request 
table (step S201) . 

Then, based on the retrieval request table a 
keyword variable table and a retrieval request 
expression variable table are generated (steps S202 
and S203), and the last expression variable ID of 
each requester thread is written to the common area 
(step S204) . 

Then, after deleting all contents of the 
retrieval request table (step S205) , the 
prohibition of writing a requester thread from 
being written to the retrieval request table is 
released (step S206) . 

FIG. 21 shows the concept of a keyword 
variable table generating process. 

A keyword variable table contains table 
information in which a plurality of item tags and 
words to be retrieved (collectively referred to as 
keywords) to be retrieved are arranged. A keyword 
is assigned a keyword variable, and has a hit flag 
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column indicating whether or not the keyword exists 
in the record to be searched. The initial value of 
the hit flag is 0. When there is a hit, the flag is 
set to 1. The hit flag is used during the 
5 retrieving process. 

An item tag and a word to be retrieved which 
are recorded in the keyword variable table are all 
item tags and words to be retrieved existing in the 
retrieval request table. However, the item tags and 

10 words to be retrieved having the same contents are 
not recorded more than once. 

FIG. 22 shows the concept of generating a 
retrieval request expression variable table. 

A retrieval request expression variable table 

15 contains table information in which a plurality of 
retrieval logic expressions are arranged. Each 
retrieval logic expression is assigned a uniquely 
specified code (hereinafter referred to as an 
expression variable) . The retrieval logic 

20 expression table stores every combination of a item 
tag and a word to be retrieved in the retrieval 
request table as a logical expression obtained by 
combining a tag variable with a word to be 
retrieved (practically an assigned keyword 

25 variable) using a logical product (and) operator. 
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The expression variable assigned to the logical 
expression is referred to as a tag expression 
variable. A tag expression variable having the same 
contents is not entered more than once. 

All retrieval condition expressions in the 
retrieval request table are replaced with a logical 
expression in which a tag expression variable is 
combined by a logical operator, and stored in the 
retrieval request expression variable table. The 
expression variable assigned to the logical 
expression is referred to as a retrieval request 
expression variable. The retrieval request 

expression variable having a retrieval logic 
expression of the same contents is not entered in 
the retrieval logic expression more than once. 

The retrieval request expression variable 
table has a last expression variable ID column and 
a hit flag column. The last expression variable ID 
of a retrieval request expression variable is 
assigned a number in order from 1. 0 is recorded in 
the last expression variable ID of a tag variable. 
The hit flag column is used in the retrieving 
process. The initial value of the hit flag column 
is 0 . 

After a retrieval request expression variable 
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table generating process, the last expression 
variable ID of a retrieval request expression 
variable corresponding to the retrieval condition 
of the requester thread is written to the 
corresponding area of each requester thread in the 
common area . 

FIG. 23 is a flowchart showing the flow of the 
retrieving process . 

In the retrieving process, a record satisfying 
a retrieval request from each requester thread is 
detected in the text data to be searched according 
to the keyword variable table and the retrieval 
request expression variable table, and the contents 
of the record are written to the retrieval result 
table for each last expression variable ID. 

The retrieving process can be roughly divided 
into a pattern matching process of detecting a 
specified character string in a file (step S231) 
and a process performed based on a detected 
character string (steps S232 through S238) . 

In the pattern matching process, a record 
delimiter and an item delimiter are added to all 
keywords in the keyword variable table, and the 
full character string collating process is 
performed from the start of the text data to be 
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searched. In the technology of the pattern matching 
process according to the present invention, the 
technology of an AC algorithm, etc. (the above 
mentioned AC method, EMB method, SA method, etc.) 
in which the processing time is independent of the 
number of keywords is used. 

First, when a keyword is hit (detected) in the 
pattern matching process, the hit flag of the 
keyword hit in the keyword variable table is set as 
true (1) (step S232) . 

When the item delimiter is hit, a retrieval 
request expression variable evaluation is performed 
(step S233) . A retrieval request expression 

variable evaluation refers to a process of 
performing a logical operation on all expression 
variables in the retrieval request expression 
variable table, and setting the value of a hit flag 
as true ( 1 ) . 

When the second item delimiter is detected in 
the case where the text data to be searched shown 
in FIG. 10 is retrieved, the status of the keyword 
variable table and the retrieval request expression 
variable table is shown in FIGS. 24A and 24B. 

After the retrieval request expression 
variable evaluation, all hit flags in the keyword 
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variable table are set as false (0) (step S234). 

When a record delimiter is hit, the last 
expression variable ID which is true (1 or larger) 
which is the last expression variable ID of a 
retrieval request expression variable whose hit 
flag is true (1) (YES is step S235) is retrieved, 
and the contents of the hit record is written into 
the column of the last expression variable ID of 
the retrieval result table (step S236) . Then, 
control is returned to step S231, and the pattern 
matching process is continued with all hit flags in 
the keyword variable table and the retrieval 
request expression variable table set as false (0) 
(step S238) . 

When the text data to be searched shown in FIG. 
10 is retrieved, the status of the keyword variable 
table and the retrieval request expression variable 
table after the retrieval request expression 
variable evaluation after the last item delimiter 
of the first record is detected is as shown in FIGS. 
25A and 25B. After the process performed after the 
trailing record delimiter of the first record has 
been detected, the contents of the retrieval result 
table are as shown in FIG. 26. 

After the retrieving process is completed, the 
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postprocess is performed. The postprocess releases 
the wait state for each requester thread. 

Described above is the first embodiment of the 
present invention. 

The second embodiment of the present invention 
is described below. 

In the first embodiment of the present 
invention, the retrieval of data in which a record 
is formed by a plurality of items is described. In 
the second embodiment, the case in which a record 
of data to be searched is not divided into items is 
described. 

FIG. 27 shows the contents of the text data to 
be searched according to the second embodiment of 
the present invention. 

The operations of the control program, the 
reception program, the requester thread, and the 
retrieval program are the same as in the first 
embodiment. However, the contents of the keyword 
variable table and the retrieval request expression 
variable table are different between the first and 
second embodiments . 

When a record is not divided into items, an 
item tag is not used in a retrieval request. 
Therefore, FIG. 28 shows the retrieval request 
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table and the keyword variable table according to 
the second embodiment corresponding to those 
according to the first embodiment shown in FIG. 21. ' 
The retrieval request expression variable table 
5 according to the second embodiment corresponding to 
that shown in FIG. 22 has no tag variable, and is 
yg shown in FIG. 29. 

Although the retrieving process is also 

f% i 

'■'f performed as shown in FIG. 23, the contents of the 

U'\ 

s 10 keyword variable table and the retrieval request 

m 

fU expression variable table obtained after the 

Q 

yj retrieval request expression variable evaluation 

P, after detecting the last item delimiter of the 

first record are as shown in FIGS. 30A and 30B.' 
15 The retrieval result table obtained after 

completing the process after detecting the last 

record delimiter of the first record is as shown in 

FIG. 31. 

Described above by referring to the attached 
20 drawings are the embodiments of the present 
invention, and the present invention has the 
following characteristics. 

(1) When a retrieval request is issued from a 
terminal, a requester thread having a right to 
25 communicate with the terminal is activated for the 
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terminal. Each requester thread writes a retrieval 
request from the terminal for which it has the 
right to communicate in one retrieval request table. 

(2) When the process of a retrieval program 
is completed, a retrieving process is performed 
with the entire retrieval requests which have been 
written to the retrieval request table processed as 
one process unit. 

(3) All item tags and words to be retrieved 
existing in the retrieval request table are 
collectively written into the keyword variable 
table regardless of a retrieval request unit. At 
this time, although there are the same item tags or 
words to be retrieved, they are not to be written 
more than once in the keyword variable table. 

(4) Every logical product (and) condition of 
an item tag and a word to be retrieved, and every 
retrieval condition expression are collectively 
written into the retrieval request expression 
variable table. At this time, the retrieval logic 
expressions of the same contents are not written 
more than once. 

(5) Numbers are sequentially written into the 
last expression variable ID column of the retrieval 
logic expression corresponding to the retrieval 
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condition expression in the retrieval request table. 
Furthermore, the assigned number is written to the 
common area associated with the requester thread 
which has written the retrieval request having the 
5 retrieval condition expression, that is, the source 
\I3 of the retrieval logic expression. 

(6) During the pattern matching process on 

0-1 

rij all keywords and text data to be searched in the 

n I 

keyword variable table, the contents of all records 
f 10 whose retrieval logic expression assigned to the 

»M last expression variable ID in the retrieval 

a 

W request expression variable table is true (1) are 

CI 

\-A written into the retrieval result table 

corresponding to the last expression variable ID. 

15 (7) The requester thread sees the last 

expression variable ID written to the common area, 
retrieves the contents of the record corresponding 
to the last expression variable ID from the 
retrieval result table, and answers the terminal 

20 with which it has the right to communicate . 

The embodiments of the present invention are 
described above by referring to the attached 
drawings, but the pattern retrieval apparatus to 
which the present invention is applied is not 

25 limited to the above mentioned embodiment so far as 



the functions can be realized. It can be applied to 
any device regardless of a single device, a system 
or an integrated device comprising a plurality of 
devices, a system for performing a process through 
5 a network such as a LAN, WAN, etc. 

CI 

^} Furthermore, the present invention can be 

ii 

realized by the system comprising a CPU, memory 
Sjj such as ROM, RAM, etc., an input device, an output 

|1 i 

;y device, an external storage device, a medium drive 

s 10 device, a portable storage medium, and a network 

fy connection device connected through a bus. That is, 

Cj 

y.| the present invention can be attained by providing 

Q 

memory such as ROM, RAM, etc., external storage 
device, and a portable storage medium storing a 

15 program code of the software for realizing the 
system according to the above mentioned embodiments 
for the pattern retrieval apparatus, and by the 
computer of the pattern retrieval apparatus reading 
the program code . 

20 In this case, the program code read from the 

storage medium realizes a new function of the 
present invention, and the portable storage medium, 
etc. storing the program code configures the 
present invention. 

25 As a portable storage medium for providing a 
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program code can be, for example, a floppy disk, a 
hard disk, an optical disk, CD-ROM, CD-R, DVD-ROM, 
DVD RAM, a magnetic tape, a non-volatile memory 
card, a ROM card, various storage media for storage 
5 through a network connection device (that is, a 

□ 

ylj communications line) such as electronic mail, 

>jQ personal computer communications, etc. 
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Furthermore, as shown in FIG. 32, the 
functions according to the above mentioned 
f 10 embodiments can be realized by the functions 

[U . according to the above mentioned embodiments by a 

Q 

lU computer 320 executing the program code read to 

M, memory 321, and by the OS, etc. operating in a 

computer performing a part or all of the actual 
15 processes at an instruction of the program code. 

Additionally, the functions according to the 
above mentioned embodiments can be realized by a 
program code read by a portable storage medium 322, 
and written to the memory 321 provided in a 
20 function extension board inserted into the computer 
320 and a function extension unit connected to the 
computer 320, and the CPU, etc. of the function 
extension board and the function extension unit 
performing a part or all of the actual processes at 
25 an instruction of the program code. 
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That is, the present invention is not limited 
to the above mentioned embodiments according to the 
present invention, but can be realized within the 
scope of the gist of the present invention. 

As described above, in the full text retrieval 
system using the character string collating method 
according to the present invention, a process can 
be performed at an exceedingly high speed as 
compared with the conventional technology when a 
large number of retrieval request are received 
within a short time. 

Furthermore, according to the present 
invention, as compared with the full text retrieval 
system requiring an index file, the software can be 
considerably small, and an index file is not to be 
maintained, thereby realizing an operable system. 

That is, when a large number of retrieval 
requests are received in time series within a short 
time in a full text retrieval system using the 
character string collating method according to the 
present invention, all retrieval requests can be 
processed in a time shorter than the value obtained 
by multiplying the time required in individually 
processing one retrieval request by the number of 
retrieval requests. For example, using a retrieval 
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engine requiring 1 second for individually 
processing one retrieval request, 100 retrieval 
requests can be completed in 3 seconds. 



